Testing Forecast Accuracy
نویسنده
چکیده
Despite the obvious desirability of formal testing procedures, earlier efforts at assessing the forecast accuracy of an estimated model revolved around the calculation of summary forecast error statistics e.g., see Klein (1991); Clements and Hendry (1993); Wallis (1995); Newbold, Harvey, and Leybourne (1999); and Stock and Watson (1999). Resort to such an informal approach may be ascribed mainly to the complexities involved in dealing with sampling uncertainties and correlations that are present in forecast errors.
منابع مشابه
The Effects of Transparency of Financial Information and Board Composition on Forecast Accuracy of Corporate Earnings
The aim of the present research is to determine the effects of financial information transparency and composition of board of directors on forecast accuracy of corporate earnings in companies. A corporation's key for success is hidden in its optimal direction. So it can be claimed that the secret of the eternal reputation of popular corporations lies in their efficient board of directors. One o...
متن کاملMeasuring forecast accuracy
It is important to evaluate forecast accuracy using genuine forecasts. That is, it is invalid to look at how well a model fits the historical data; the accuracy of forecasts can only be determined by considering how well a model performs on new data that were not used when estimating the model. When choosing models, it is common to use a portion of the available data for testing, and use the re...
متن کاملIn-Sample Tests of Predictive Ability: A New Approach
This paper presents analytical, Monte Carlo, and empirical evidence linking insample tests of predictive content and out-of-sample forecast accuracy. Our approach focuses on the negative effect that finite-sample estimation error has on forecast accuracy despite the presence of significant population-level predictive content. Specifically, we derive simple-to-use in-sample tests that test not o...
متن کاملUsing Receiver Operating Characteristic Analysis to Evaluate Large-Change Forecast Accuracy
This paper applies receiver operating characteristics (ROC) analysis to M3 Competition, micro monthly time series for one-month-ahead forecasts. Using the partial area under the curve (PAUC) criterion as a forecast accuracy measure and paired-comparison testing via bootstrapping, we find that complex methods (AutomatANN, Flores-Pearce2, Forecast ProSmart FCS, and Theta) perform best for forecas...
متن کاملLarge-change forecast accuracy: Reanalysis of M3-Competition data using receiver operating characteristic analysis
This paper applies receiver operating characteristic (ROC) analysis to micro-level, monthly time series from the M3-Competition. Forecasts from competing methods were used in binary decision rules to forecast exceptionally large declines in demand. Using the partial area under the ROC curve (PAUC) criterion as a forecast accuracy measure and paired-comparison testing via bootstrapping, we find ...
متن کامل